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Abstract 

Suppose that at any stage of a statistical experiment a control vari- 
able X that affects the distribution of the observed data Y can be used. 
The distribution of Y depends on some unknown parameter 9, and we 
consider the classical problem of testing a simple hypothesis Hq : 9 = 9q 
against a simple alternative Hi : 9 = 9i allowing the data to be con- 
trolled hy X, in the following sequential context. 

The experiment starts with assigning a value Xi to the control vari- 
able and observing Yi as a response. After some analysis, we choose 
another value X2 for the control variable, and observe 12 as a response, 
etc. It is supposed that the experiment eventually stops, and at that 
moment a final decision in favour of Hq or Hi is to be taken. 

In this article, our aim is to characterize the structure of optimal 
sequential procedures, based on this type of data, for testing a simple 
hypothesis against a simple alternative. 
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1 Introduction. Problem Set-Up. 

Let us suppose that at any stage of a statistical experiment a " control variable" 
X that affects the distribution of the observed data Y can be used. " Statisti- 
cal" means that the distribution of Y depends on some unknown parameter 6, 
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and we have the usual goal of statistical analysis: to obtain some information 
about the true value of 6. In this work, we consider the classical problem of 
testing a simple hypothesis Hq : 6 = 6q versus a simple alternative Hi : 6 = di 
allowing the data to be controlled by X, in the following "sequential" context. 

The experiment starts with assigning a value Xi to the control variable 
and observing as a response. After some analysis, we choose another value 
X2 for the control variable, and observe I2 as a response. Analyzing this, 
we choose X3 for the third stage, get Ya, and so on. In this way, we obtain 
a sequence Xi, . . . , X„, Yi, . . . , 1^ of experimental data, n = 1, 2, . . . . It is 
supposed that the experiment eventually stops, and at that moment a final 
decision in favour of Hq or Hi is to be taken. 

In this article, our aim is to characterize the structure of optimal sequential 
procedures, based on this type of data, for testing a simple hypothesis against 
a simple alternative. 

Let us write, briefly, X^") instead of [Xi, . . . , Xn), Y'^^'> instead of (Fi, . . . , F^i), 
etc. Let us define a (randomized) sequential hypothesis testing procedure as a 
triplet (x, V') 0) of a a control policy x, a stopping rule ip, and a decision rule 
(p, with 

X = {Xl,X2,---,Xn,---), 
<t>^ (01,02, ■■■>«,■■■)) 

where 

Xn^Xn{x^''-'\y^''-'^) 

n = 1,2,... are supposed to be measurable functions with values in the space 
of values of the control variable, and the functions 

V;„ = V^„(x(-),l/('^)), 0„ = 0„(x("),/")) 

are supposed to be some measurable functions with values in [0, 1]. 
The interpretation of these functions is as follows. 

The experiments starts at stage n = 1 applying xi to determine the initial 
control xi. Using this control, the first data yi is observed. 

At any stage n > 1: the value of tpn{x^"\ y^^^) is interpreted as the con- 
ditional probability to stop and proceed to decision making, given that that 
we came to that stage and that the observations were (yi, 1/2, • • • , Hn) after the 
respective controls {xi,X2, ■ ■ ■ , Xn) have been applied. If there is no stop, the 
experiments continues to the next stage, defining first the new control value 
Xn+i by applying the control policy: Xn+i — Xn+i{x^^^ ; y^'^^) and then taking 
an additional observation yn+i using control Xn+i- 

Then the rule i/jn+i is applied to (xi, . . . , Xn+i, yi, . . . , Vn+i) in the same 
way as as above, etc., until the experiment eventually stops. 



Optimal Sequential Testing with Control 



3 



It is supposed that when the experiment stops, a decision to accept or to 
reject Hq is to be made. The function (f)n{x^^\ U^^^) is interpreted as the condi- 
tional probabihty to reject the null-hypothesis Hq, given that the experiment 
stops at stage n being (yi, . . . , yn) the data vector observed and {xi, . . . , Xn) 
the respective controls applied. 

The control policy x generates, by the above process, a sequence of random 
variables Xi, X2, . . . , X^, recursively by 

The stopping rule i/j generates, by the above process, a random variable Ty, 
{stopping time) whose distribution is given by 

Pe(^^ = ^) = ^6^(1 - - V'2) . . . (1 - V'n-l)V'n- (1) 

Here, and throughout the paper, we interchangeably use ipn both for 
and for 

and so do we for any other function 

F„ = F,(x("),|/('^)). 

This does not cause any problem if we adopt the following agreement: when 
Fn is under probability or expectation sign, it is Fn{X^^\Y^^^), otherwise it is 
F,(x('^),7/W). 

For a sequential testing procedure (%, •0,0) let us define the type I error 
probability as 

00 

«(X, tp: 0) = P0o( reject Ho) = ^ ^^^(1 - -^i) ... (1 - i^n-iji^nK (2) 

n=l 

and the type II error probability as 
/3(X, t/;, 0) = P,,( accept i/o) = - V'l) • • • (1 - i^n-i)M^ - ^n)- (3) 

n=l 

Normally, we would like to keep them below some specified levels: 

q;(x,'0>0)<« (4) 

and 

PMA)<(5 (5) 
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with some a,P E (0, 1). 

Another important characteristic of a sequential testing procedure is the 
average sample number. 

^) ^ E}r, ^ "f" - ^» < - 1- (6) 

I cxD otherwise. 

Our main goal is minimizing N{x,il^) = N{9q\Xi'4') over all sequential 
testing procedures subject to (jl]) and Our method is essentially the same 
that we used in [3] in the problem of sequential testing of two simple hypotheses 
without control variables. 

In Section [21 we reduce the problem of minimizing A^(x, ^) under con- 
straints (jll) and (l5l) to an unconstrained minimization problem. The new 
objective function is the Lagrange-multiplier function L{x,ip,(f))- 

In Section [31 we find 

In Section [H we minimize L{x, tp) in the class of truncated stopping rules, 
i.e. such that ifjN = 1- 

In Section [5l we characterize the structure of optimal strategy (x, ^) in the 
class of non-truncated stopping rules. 

In Section [6l the likelihood ratio structure for optimal strategy is given. 

In Section [71 we apply the results obtained in Section [2]- Section [5] to min- 
imizing the average sample number N{x, tp) over all sequential testing proce- 
dures subject to (jlD and 

2 Reduction to Non-Constrained Minimization 

To proceed with minimizing ^ over the testing procedures subject to (jlj) and 
([5]) let us define the following Lagrange-multiplier function: 

L(x, ^, 4>) = N{x, i^) + Aoa(x, ^, 0) + Xif3{x, ^, 0) (7) 

where Aq > and Ai > are some constant multipliers. 
Let A be a class of sequential testing procedures. 

The usual relation between the constrained and the non-constrained mini- 
mization is given by the following 

Theorem 2.1. Let exist Aq > and Ai > and a testing procedure 
{x*, '0*, 4>*) G A such that for any other testing procedure {x, ^Z', 0) G A 



L{x*,r,<Pl<L{x,^A) 



(8) 
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holds and such that 

a{x*,rAn = a and (3{x* ,r A*) = P- (9) 
Then for any testing procedure -i/^, 0) G A satisfying 

a(x,^,(^)<a and P{x,i^,S)<P (10) 

it holds 

N{x\r)<N{x,ij). (11) 
The inequality in / fli]) is strict if at least one of the equalities pOj) is strict. 

Proof. Let (xj-^j^) G A be any testing procedure satisfying ffTOj) . Because of 

L(x*, V'*, 0*) = iV(x*, + Aoa(x*, 0*) + Ai/3(x*, 

< L{x, ip, 0) = N{x, tp) + Xoaix, i^, 0) + Xif3{x, ^, <P) (12) 

<iV(x,^) + Aoa + Ai/3, (13) 

where to get the last inequality we used (HI) and ([5]). 
So, 

N{x*, r) + Xoaix*, r, 0*) + Ai/?(x*, 0*) < iV(x, ^) + Ao« + Xif3, 
and taking into account conditions ([9]) we get from this that 

N{x*,r)<N{x,i^)- 

The get the last statement of the theorem we note that if N[x*i4'*) = 
iV(x, -0) then there are equalities in f|T2|) - f|T3|) instead of inequalities which is 
only possible if a(x, ■0, 0) = a and /3(x, ^, 0) = /3. □ 

3 Optimal Decision Rules 

In this section, we start solving the problem of minimizing the Lagrange- 
multiplier function L{x,'^i(f>) over all sequential testing procedures: we first 
find 

inf L(x,^A,0), 

and the corresponding decision rule, at which this infimum is attained. 
Let Ia be the indicator function of the event A. 

From this time on, we suppose that for any n = 1,2,..., the random 
variable Y, when a control x is applied, has a probability "density" function 



feiy\x) 



(14) 
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(Radon-Nicodym derivative of its distribution) with respect to a a-finite mea- 
sure fi on the respective space. We are supposing as well that, at any stage 
n > 1, given control values Xi,X2, ■ ■ ■ Xn applied, the observations Yi,Y2, . . . ,Yn 
are independent, i.e. their joint probability density function, conditionally on 
given controls Xi,X2, ■ ■ ■ Xn, can be calculated as 

n 

/g"(xi,...,x„;2/i,...,?/„) = JJ/ed/iki), (15) 

i=l 

with respect to the product-measure ^^ = iJL®---®iioiiin times by itself. 
It is easy to see that any expectation, which uses a control policy Xi can be 
expressed as 

E^g{Y^-^) = [ ^/(t/("))/r(?/^"^)^^"(l/^"^), 



where 

n 
i=l 

with 

x, = x^{x^'-'\y^''-'^) (16) 

for any i = 1,2, . . . . 

Similarly, for any function F„ = Fn{x^"\y^^^) let us define 

F„>^(y(")) = F„(x("\2/(")) 

where defined by (ITBi) . 

As a first step of minimization of L{x-, i^, 4>), let us prove the following 

Theorem 3.1. For any Aq > and Ai > and for any sequential testing 
procedure (x, ip, (j)) 

L{x,iJ,(P)>L{x,iJ,<Pn (17) 

oo „ 

= Nix,i^) + Yl /(l-^f)...(l-V'^i)^i^min{Ao/,';^Ai/;;W- (18) 

n=l ^ 

with 

0* = (0t,0;,...,(^:,...) (19) 

where 

'f'n = ^{Xof^^<X^f^^} (20) 

Proof. Inequality ( fTTl) is equivalent to 

\oa{x, ^, 0) + Ai/3(x, i^, 0) > Aoa(x, ^, 0*) + Xi(3{x, i^, 0*)- (21) 

We prove ( l2Ti) by finding a lower bound for the left-hand side of ( 12T1) and 
proving that this lower bound is attained at = 0* defined by ( l20l) . 
To do this, we will use the following simple 



Optimal Sequential Testing with Control 



7 



Lemma 3.2. |^ Let (p, Fi, F2 be some measurable functions on a measurable 
space with a measure fi, such that 

< (p{x) < 1, Fi{x) > 0, F2{x) > 0, 

and 

/mmW(x),F.(,r)}dM.x)<oo. 

Then 

{(f){x)Fi{x) + (1 - (f){x))F2{x))dfi{x) 



> j mm{Fi{x),F2ix)}dfx{x) (22) 
with an equality if and only if 

I{Fi{x)<F2ix)} < <Pix) < I{Fi{x)<F2{x)} (23) 

jjL-almost everywhere. 

Starting with the proof of ([21]), let us give to the left-hand side of it the 
form 

Aoa;(x, V,0) + Ai/3(x, V',^) 

00 „ 

= E / (1 - ^1') • • • (1 - ^n-Mim^fe::" + (1 - 0^)Ai/r]^/^" (24) 

n=l 

(see da)). 

Applying Lemma 1 to each summand in ^IM we immediately have: 

Aoa(x, V',^) + Ai/5(x, ^Z', 0) 

CO „ 

> E / (1 - ^i") • • • (1 - V'n-i)^^ min{Ao/,7' ^^fei^'W (25) 

n=l 



with an equality if 



for any n = 1,2, ... . But in this case the right-hand side of (|2Si) is Xoa^i/j, 0*) + 
Ai/?(V',0*)), so we get ([21]). □ 

Remark 3.3. It is easy to see, using (j^ and l[2^) . that for any {Xi4') S'wc/i 
that Pg^{T^, < 00) the minimum value L{x, ''p , (f)*) in (11) can be represented as 



n=l 



HX, ^) = E / (1 - O • • • (1 - ^n-l)^n" + (26) 



where, by definition, 

L = mm{Xofl,Xifl}. 
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Let us denote, for the rest of this article, 

St = il-^l)...il-^rr-l)^l^n and = (1 - V'l) • • • (1 " ^n-l) 

for any n = 1,2,.... Respectively, 

st'^ = {l-i;^)...{l-ijU)i:^ and c^^ = (1 - . . . (1 - 

for any n = 1, 2, . . . . 

Let also 

Ct'^ = : (1 - ... (1 - > 0}, 

for any n > 2, and let Cf'^ be the space of all y^^\ and finally let 

Ct^^ = : (1 - ... (1 - V'^d/^"))) > 0}, 

for any n> 1. 

4 Truncated Stopping Rules 

Our next goal is to find a control policy x and a stopping rule ifj minimizing 
the value of in (l26ll . 

In this section, we solve, as an intermediate step, the problem of minimiza- 
tion of L(x, ip) over all x and i/j, where ip G A^, the class of truncated stopping 
rules, that is, 

^ = (^i,V'2, • • • , V'JV-i, 1, • • •)• (27) 
The following lemma takes over a large part of work of doing this. 

Lemma 4.1. Let r > 2 be any natural number, and let Vr = Vr{x^^\ y^'''^) be 
any measurable function. Then 

E / 4'Hnfr + l^)dfi'' + I cpHrf,'^ + v^)df^^ 

n=l ^ 

r-2 

> 



E / 't'Hnfr + IDdf^"" + / cfA {{r - l)/r''" + vU) df^-\ (28) 

n=l ^ 

with 

Vr-i = mm{lr-u /r' + ^r-l}, (29) 



where 

Rr-i{x''''''^\y^'''^^) = mm I Vr{xi, . . . ,Xr;yi, . . . ,yr)dfi{yr) (30) 
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There is an equality in if and only if 

^{/?_i</r'''^+«?-i} - '^^'^ - ^{'?-i</r''''+«?-i} 

fi^^^-almost everywhere on Cf^, and 

v^{y^^^)dt,{yr) = RUiy^''-'^) (32) 



IJ,^ ^-almost everywhere on Cf^. (We suppose that Rr-i defined by ^3^) is a 
measurable function of its arguments). 

Proof. To prove (128!) . it is sufficient to show that 

^tMir - + l^.,)dt,^-' + [ cf^ [rfl^^ + v^) d^^ 



> j 4'M{r-l)fl-'^^ + vU)d^i'-\ (33) 
By the Fubini theorem, the left-hand side of ( l33i) is equal to 

t\{{r - l)/r''" + lU)d^^'-' + I { I irf^'^ + v^) df^iyr)] df,^-' 



ctM^P^-iiir - l)/r''^ + /?-i) + (1 - V'?-!) / (r/;'^ + <) df,{yr)W^-\ 

(34) 



Because of ( fT5l ) 

' f^,{x^^\y^^^)df,iyr) = /;-i(x('-i),y(^-i)), 
so that the right-hand side of transforms to 



(r - i)/r''" + ^1^?-! + (1 - 'ei)(/r''" + / ^^^/^(y.)) 



r-l 



> y cf5j(r--l)/;-^'>^ + ^?_A^_, + (l-ei)(/r''" + ^?-i)]^^^^^^ (35) 
Applying Lemma [3.21 with 

we see that the right-hand side of ([35]) is greater than or equal to 
/ ct\ [{r - l)/r^->^ + min{/?_„ /J-^'^ + R^}] d^.^' 
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ct-Mir-l)fr'''' + v^-iW-\ (36) 

by the definition of Vr-i in fl29|) . 

Moreover, by the same Lemma 1, the right-hand side of fl35|) is equal to 
f l36l) if and only if ipr-i satisfies f l3Tl) //''"^-almost everywhere on Cf^i- 

In addition, there is an equality in if and only if Xr satisfies f l52|) 
/i^~-'^-almost everywhere on Cf^. □ 

The following Theorem gives some lower bounds for L{x, "0) when the stop- 
ping rule "0 is truncated {i/j G A^) and characterizes the stopping rules that 
attain these bounds. 

Theorem 4.2. Let i/j G be any (truncated) stopping rule, and x o.iT'U 
control policy. Then for any 1 < r < N — 1 the following inequalities hold true 

n=l 

^^^^ 

> E / st'^inf-f^ + ll)d^,- + I cf^ {rfl;;^ + y,^'>^) d^^\ (38) 

n=l 

where Vff = In, and recursively for k = N, N — 1, . . .2 

Vl, = mm{k_,J^;' + R^_,}, (39) 

with 

Rt, = Rtiix^'-'^;y^'-'^) = mm [ V^"" {x,, . . . ,x,-y,, . . . ,yMy,). (40) 

J 

The lower hound in ^33\) is attained if and only if 

hii<f:;,^-^K'^} ^ "f^k < ^{zx</^^-+<.x} (41) 

H^-almost everywhere on C^'^ and 

<'"(2/^'^) = / <f rf^(?/.+i) (42) 

^''-almost everywhere on Cf'^, for any k = r, . . . , N — 1. 

Remark 4.3. It is supposed in Theorem \4.2 and in what follows in this 
article that all the functions defined by ( f^^ are well-defined and measurable 
for any k = 1,2, ... ,N and for any N = 1,2,..., and that Rq defined by 
below is well defined as well (this is true, for example, if Xi can take only a 
finite number of values for any i = 1,2, . . . ). 
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Proof. There is an equality in (1371) if r = — 1. The rest of the proof imme- 
diately follows from Lemma 14.11 by induction. □ 

Corollary 4.4. For any truncated stopping rule i/j G A^, and for any 
control rule x 

L(x,V')>l + <, (43) 



where 



< = min / ^^^(xi; yi)d^i{y,). (44) 



The lower bound in is attained if and only if is satisfied fi'^- almost 
everywhere on C^'^ and [(^ ) is satisfied fi'' -almost everywhere on C^'^, for 



any k = 1,2, . . . , N — 1 and, additionally, 

Ro = J vfixi;yi)dKyi)- (45) 

Remark 4.5. It is obvious that the testing procedure attaining the lower 
bound in is optimal among all truncated testing procedures with i/j G A^. 
But it only makes practical sense if 

min{Ao, Ai} > 1 + . 

The reason is that min{Ao, Ai} can be considered as "the L{x,ip)" func- 
tion for a trivial sequential test (ipOi'Po) which, without taking any observa- 
tions, makes the decision (j)Q = /{Ao<Ai}- In this case there are no observations 
(N{6; ipo) = 0) and it is easily seen that 

^(^0, 0o) = Aott(^o, 4>o) + Ai/?(^o, 0o) = min{Ao, Ai}. 
Thus, the inequality 

min{Ao,Ai} < 1 + 

means that the trivial test (-00, 0o) is not worse than the best testing procedure 
with i/j from A^ . 

Because of that, we consider 

= min{min{Ao, Ai}, 1 + R^} 

as the minimum value of L{x,i^) for "0 G A^, when taking no observations is 
permitted. It is obvious that this is a particular case of with k = 1, if we 
define /q = min{Ao, Ai} and fg^ = 1. 
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5 Non- Truncated Stopping Rules 

In this section we characterize the structure of general sequential testing pro- 
cedures minimizing L{x,il^)- 

Let us define for any stopping rule -0 and any control policy x 



n=l 



(46) 



This is the Lagrange-multiplier function corresponding to if) truncated at A^, 
i.e. the rule with the components = ('01, -02, ■ • • t'^Pn-i, 1, • • •)• 

L^(x,^) = L(x,^^). 

Because -0^ is truncated, the results of the preceding section apply, in 
particular, the inequalities of Theorem 14.21 

The idea of what follows is to make ^ oo, to obtain some lower bounds 
for L(x,^) from (JHTj) - (|38|). 

And the first question is: what happens to L7v(x,'0) when A^ — > ool 

Let us denote by ^ the set of all strategies (x, ip) such that 

limE,^^(l-0i)...(l-^„) = O. (47) 

It is easy to see that (H7j) is equivalent to 

PI{t^ < oo) = 1 

(see (C])). 

Lemma 5.1. For any strategy {x,'^) ^ ^ 

lim Ljv(x,^) = L{x,i^). 

Proof. Let L{x,'4^) < oo, leaving the possibility L{x,4') = oo till the end of 
the proof. Let us calculate the difference between L(x, 0) and L^iXji^) 
order to show that it goes to zero as A^ oo. By (HGl) 



oo „ 
n=l ^ 

N-l 

n=l ^ ^ 

OO p p 

= E / ^(^/.r + ^^)^/^" - / 4" (a^/.!'" + 1%) d^^'' 

AT ^ J 



(4J 
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The first summand on the right-hand side of (HHll converges to zero, as 
N oo, being the tail of a convergent series (this is because L(x, -0) < oo). 
We have further 

1 < Ao 1 4'V,^'^d/z" = Aoi?,^„(l - V^i) . . . (1 - ^ 

as ^ oo, because of fHTj) . 
It remains to show that 

y^'^A^/jl^d/i" ^ as iV-^oo. (49) 
But this is again due to the fact that L{x, ip) < oo which implies that 

oo 

^1^^ = ^^Peoi^^ = n) < oo. 

n=l 

Because this series is convergent, J2'^=n ''^-^eoi^-^ = n) 0. Thus, using the 
Chebyshev inequality we have 

oo 

NP^^^ir^ >N)< ElT^I{r,>N} = Yl ^PeS^^ = n) ^ 

n=N 

as OO, which completes the proof of ( l49l) . 
Let now L{x,4') = oo. 
This means that 




which immediately implies by fH6|) that 

N-l „ 

Ln{x, i^)>J2 ^nHnf^;>' + ll)d^,^ ^ oo. 

n=l ^ 

□ 

The second question is about the behaviour of the functions V^!^ which 
participate in the inequalities of Theorem 14.21 as iV — >^ oo. 

Lemma 5.2. For any r > 1 and for any N > r 

> (50) 
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Proof. By induction over r = A^, A^ — 
Let r = N. Then by (EHl) 



V^+' = min{/^, /j^ + min / V^+'dfiiy^^,)} < = . 

^N+l J 

If we suppose that (150]) is satisfied for some r, > r > 1, then 
K^, = min{/,_i,/;-i + min [ K'^rf^d/r-)} 

> min{/,_i, + min [ = K-f • 

Xr J 

Thus, f lSOl) is satisfied for r — 1 as well, which completes the induction. □ 

It follows from Lemma 15.21 that for any fixed r > 1 the sequence V/' is 
non- increasing. So, there exists 

Vr = lim V;^. (51) 

N—fOO 

Now, everything is prepared for passing to the limit, as iV — > oo, in fl37p 
and dM]) with %Ij = . 



Theorem 5.3. Let x be any control policy and i/j any stopping rule. Then 
for any r > 1 the following inequalities hold 

n=l 

^^^^ 

> E / st^{nf-;^ + ll)d^^- + I ct'^ {rfll^ + V^) (53) 

where 

K = min{/„/;+i?,}, (54) 

being 

Rr = /2.(xW,i/M) = min / Vr+,{x^'^'\y^''+'^)dfi{yr+i). (55) 

Xr + l J 

In particular, for r = 1, the following lower bound holds true: 

L{x,i^)>l + J Vi{xi,yi)d^i{yi)>l + Ro, (56) 



where, by definition. 



Ro = min / Vi{xi,yi)dfx{yi) 
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Proof. Let (x, i/j) ^ ^ he any strategy. Then, by Lemma 15.11 the left-hand 
side of ( |37j) tends to L(x, ip) a.s N ^ oo. 

By the Lebesgue monotone convergence theorem, in view of Lemma 15.21 
passing to the hmit on the right-hand sides of fl37|) and fl38l) is possible as well. 
Thus, §^ and ([53]) follow. 

Let us now prove ([SID, starting from 

K^ = min{Z„ + (57) 

with 



= min / VJlMyr+i) (5^ 

a;r+i J 



(see f l39|) and fl^Oj) . respectively). 

By Lemma [5^ the left-hand side of fl57|) tends to K- Additionally, 

= min J VJl-^dfi{yr+i) < j K+WAi(yr+i), 

so 



lim R^ < lim / V^,^dii{yr+i) = / Vr+id^{yr 

N^oo N^oo J J 



N- 

by the Lebesgue theorem on monotone convergence. Thus, 



N 

On the other hand, for any > 1 



lim R^ < min / Vr+idn{yr+i) = Rr- (59) 

V'— >oo a^r+l / 



V^.^dfi{yr+l) > / Vr+ldfl{yr+l 



R^ = min / VJl^dfi{yr+i) > min / K+iC?/^(l/r+i) = Rr 



so 



X,- + l J Xr + l 

hence 



lim R^ >Rr. 



From this and fl59l) . we get that 



lim R^ = Rr. 



Therefore, from fl57D it follows that 



K = lim T/^ = min{/„ + Rr}, 



which proves (1541) . 



□ 
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Let us note now that the right-hand side of (l56il coincides with 

inf L(x,^). 

(x,'/')e^ 



Lemma 5.4. 



Proof. Let us denote 



inf L{x,ij) = l + Ro. (60) 



TV 



/7= inf Un = 1 + R(; 

By Theorem 3, for any = 1, 2, . . . 

Un = inf L{x,ip). 

Obviously, Un > U for any = 1, 2, . . . , so 

hm t/7v > U. (61) 

Let us show first that in fact there is an equahty in fl6Tl) . 
Suppose the contrary, i.e. that hmjv^oo Un = U + ie, with some e > 0. We 
immediately have from this that 

UN>U + 3e (62) 

for all sufficiently large A^. 

On the other hand, by the definition of U there exists a "0 such that U < 
^(X, ^) < + e and (x,^)e^. 

Because, by Lemma \5A] Ln{Xj "0) ~^ L{xi i^), as — * oo, we have that 

LNix,i^)<U + 2e (63) 

for all sufficiently large A^ as well. Because, by definition, Ln{Xt'^) ^Un, 
have that 

Un <U + 2e 

for all sufficiently large A^, which contradicts (!62l) . 
Thus, 

lim Un = U. 
Now, to get fl60|) we note first that 

U = lim Un = 1+ lim inf / {xi;yi)diJ,{yi) 

N-^oo N~iOO xi J 
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< 1 + inf / Vi{xi; = 1 + Rq. 

XI J 

On the other hand, by Theorem 15.3^ 

f/= inf L(x,^)>l + i?o, 

thus, 

U = l + Ro. 

□ 

The following theorem characterizes the structure of the control- and the 
stopping-part of optimal sequential testing procedures. 

Theorem 5.5. // there is a strategy {Xj4') ^ ^ snc/i that 

L(x,V') = ^ ,inf ^Hx',^'), (64) 

then 

hll<fel^+Rl} ^'^k< I{q<f^^>c+RX} (65) 

fi'' -almost everywhere on Cf'^, and 

J V,l,df,iy,^,) = Rl (66) 

jj' -almost everywhere on C^'^, for any k = 1,2 . . . , where xi is defined in such 
a way that 

J V,^dfi{y,) = Ro. (67) 

On the other hand, if a strategy {i/j, x) satisfies l[65\) fi'' -almost everywhere 
on C^'^ , and satisfies [6D\) (jJ^-almost everywhere on Cf'^, for any k = 1,2 . . . , 
where Xi is such that ( [^^ is fulfilled, then (-0, x) ^ o.^'^d ( f^TP holds. 

Proof. Let (x, -0) G ^ be any strategy. By Theorem 15.31 for any fixed r > 1 
the following inequalities hold: 

L{X. i')>Y.I stHnf-^"" + li)dfi'' + I ct'^ ((r + 1)/;+^'^ + F^,) d^^+' 

n=l ^ ^ 

(68) 

> E / stHnfef" + IDdlJ- + / cf^ {rfl;^ + V^) d/.^ (69) 

n=l 

> ... 



> j me;^ + V + y (1 - V^D (2/,'-^ + V^) di? (70) 

> 1+ [ V^dii >l + Ro. (71) 



18 



Andrey Novikov 



Let us suppose that the right-hand side of (17T1) is attained by some [x, "0) € 
This means that there are equahties in all of the inequahties (|68l) - ( |7T1) . 
Then, first of all, we get that 

Ro = j V^{y,)dii{y,), (72) 

and, successively for = 1, 2 . . . , each time applying Lemma [4. 1^ that 

//*^-almost everywhere on C^'^, and 

V;'ii(l/^'^'^)^/i(?/.-M) = ^L (74) 



/i'^-almost everywhere on C^'^. The first part of Theorem 15.51 is proved. 

To prove the second part, let us suppose that (x,^) satisfies fl72l) - fITil) . 



Applying Lemma [4.H we see that all the inequalities in (|69|) - (I7T|) are in fact 
equalities for i/j = i/j^ = (-01, . . . , i/jr, 1, . . . ). 
In particular, this means that there exists 



From this, it follows immediately that there exists as well 
hm ^ / + ^n)df^'' < 1 + ^0, 



(75) 
(76) 



n=l 

and that 



limsup fcf-rn-i,' = lims„p(rP,«(r, > r)) < oo^ (77) 

r—>oo J r—>OQ 

From (1771) it follows that Pf^ir^ > r) ^ 0, as r — > cxd, i.e. that (x, "0) ^ 
Now, the left-hand side of fff^ is L{x,4') (because (x, ^) ^ '^)5 and hence 

L(x,^) < l + /2o. (78) 

On the other hand, by virtue of fl68l) - fl7T]) L{x,4') > 1 + -Ro- From this, 
and (I78|) . we see that L(x, -0) = 1 + _Ro- Because, by Lemma [5^ 

^inf ^L(x',^') = l + ^o, 
this proves the second part of Theorem 15. 5[ □ 
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Remark 5.6. Theorem 15.51 treats the optimality among strategies which 
take at least one observation. If we allow not to take any observation, there is 
a possibility that the trivial testing procedure (see Remark \4 .51 ) gives a better 
result. It is easy to see that this happens if 

mm{Ao, Ai} < 1 + Rq. 

Remark 5.7. In a particular case when the control variable takes only one 
value, X, Theorem 15.51 characterizes the optimal stopping rule in the problem 
of testing two simple hypotheses for independent identically distributed (with 
density feiylx)) observations (see JE/, J3jl, l^)- It is very well known that the 
optimal stopping rule is based, in this particular case, on the likelihood ratio 
statistic (and the resulting test is known as the Sequential Probability Ratio 
Test (SPRT) 15]). Because of this, we will dedicate the following section to 
finding a likelihood structure of the optimal stopping rule in Theorem \5.5\ in 
the general case of non-trivial control variables. 



6 Likelihood Ratio Structure of Optimal Strategy 

In this section, we will give to the optimal strategy in Theorem 15.51 an equiv- 
alent form related to the likelihood ratio process. 
Let us start with defining the likelihood ratio: 

Let us introduce then the following sequence of functions: 

po{z) = g{z) = min{Ao, Xiz}, (79) 

and for k = 1, 2, 3, ... : 



pk{z) = min !^g{z), 1 + mm j /, 



eM^)Pk-i { ) dM } (80) 



(we are supposing that all pk, k = 0, 1, 2, . . . are well-defined and measurable 
functions of z). It is easy to see that (see fl5^ . fHU]) ) 

andfoT k = N -1,N -2,...,1 

= Ap^-fc(^fc). (81) 
It is not difficult to see (very much like in Lemma [5.21) that 

Pkiz) > Pk+i{z) 
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for any = 0, 1, 2, . . . , so there exists 

p{z) = lim p^{z). (82) 

n— ►oo 

Using arguments similar to those used in the proof of Theorem 15.31 it can be 
shown, starting from (IHOj) . that 

p{z)= mm {g{z),l + R{z)}, (83) 

where 

' •^"■'"l^'^ d,(y). (84) 



R{z) = mm j feo{y\x)p (^z 



feoiy\x) 

Let us pass now to the hmit, as ^ oo, in flHTj) . We see that 

y, = 4p(Z,). 

Using these expressions in Theorem 15.51 we get 

Theorem 6.1. If there exists a strategy (Xii^) ^ such that 

L(x,^) = ^ ,inf ^L(x',^'), (85) 

then 

ha{z^)<^+R{z^)} ^^k< h9{zl)<i+R{zl)} (86) 

Pg^-almost sure on 

{y^'^ : (1 - (y«)) ... (1 - VkM'-'^)) > 0}, (87) 

and 

J feMxk-,i)p (^^'1^1^) My) = R{zl) (88) 

P^^- almost sure on 

{y^'^ : (1 - ^f(2/«)) ... (1 - Vuiy^'^)) > 0}, (89) 
where xi is defined in such a way that 



(90) 



On the other hand, if {x, "0) satisfies Pg^-almost sure on [8l\ ) and satisfies 



123) P^^-almost sure on ^EW> f^i" o^?/ k = 1,2,..., where Xi satisfies (E^, 
then (x, ip) E ^ and (x, ip) satisfies 
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Remark 6.2. It is not difficult to see (very much like in ^) that when 

1 + R{oo) = 1 + lim R{z) > Aq, (91) 

there exist < A < B < oo such that g{z) > 1 + R{z) (see (E^j is equivalent 



to z E (A,B). By Theorem 7J_, this implies, in particular, that the optimal 
stopping rule is of an SPRT type: stopping occurs when for the first time 
exits an interval. Nevertheless, unlike the classical problem of sequential test- 
ing, this does not help very much in this case of a statistical experiment with 
control, because an essential part of the problem is the construction of the op- 
timal control rule (see ^SB^), and there is no apparent way to relate it to the 
stopping constants A and B. 

If ( fgij) does not hold, the optimal stopping rule is still simple, but may 
seem somewhat strange. For example, if I + -R(oo) < Aq, then the optimal 
strategy prescribes to stop when, for the first time, drops below some A > 
0, and accept Hq at that time. In this case, obviously, the experiment may 
continue indefinitely, with a large probability, if the alternative hypothesis is 
true. This does not make much practical sense, and we are not sure that this 
may ever happen in any testing problem with non-trivial control, but we are 
unable, generally speaking, to prove that [91\) is always fulfilled. 

The reason why the optimal stopping time may not have a finite expectation 
under one of the hypotheses lies in the definition of the error probabilities ^ 
and that do not penalize continuing the experiment indefinitely, and/or in 
the fact that the average sample number under the alternative hypothesis is 
not taken into account when minimizing the "risk" (see definition of L{x,ip) 
in Similar phenomenons occur even in the "no-control" case and even 

when the observations are independent and identically distributed, if the aver- 
age sample number under one of the hypotheses is disregarded as a criterion of 
optimization (see fl^J). Taking into account the average sample number under 
both the null- and the alternative hypothesis remedies this problem (see Remark 
E3j below. 

Remark 6.3. Considering as a criterion of optimization, instead of N{x, ip) - 
Eg^T^ in Ij^, a weighted sum of the two average sample numbers: 

N{X, 1p) = T^oE^T^ + 'KlE'^T^, 

where ttq and tti are some positive numbers, leads to a Bayesian problem of se- 
quential testing in the present context. There are almost evident modifications 
of Theorems \4-S\ \5.3[ 15.51 and \6.1\ giving solutions to the respective Bayesian 



problems as well. For example, instead of (E^j it should be used 

V.'L, = min{4_i, nof^-' + nj^'' + R^i}, (92) 
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( fTij j should be modified to 



etc., etc. 



T Application to the Conditional Problem 

In this section, we apply the results obtained in the preceding sections to 
minimizing the average sample size N{xi "0) = ^^^'^^ ^^^"^ sequential testing 
procedures with error probabilities not exceeding some prescribed levels. 
Combining Theorems I2.H 13.11 and 16. we immediately have the following 

Theorem 7.1. Let {x,'^) satisfy the conditions of Theorem \6.1[ and let 
be defined by 

= ^{Ao/g';,<Ai/,';} (94) 

for n = 1,2, ... . 

Then for any sequential testing procedure {x',ip', 4>') such that 

«(x',^',0')<«(x,^,0) and /?(x',^'>') </3(x,^,0) (95) 

it holds 

N{^,ij')>N{x,^). (96) 

The inequality in / fP^) is strict if at least one of the inequalities in / fP3]) is 
strict. 

If there are equalities in all of the inequalities in 1^3]) and [9d\] . then (%', ip') 
satisfies the conditions of Theorem \ 6.1\ as well ( with x' instead of x o,nd if)' 
instead ofip). 

Proof. The only thing to be proved is the last assertion. 
Let us suppose that 

/3(X',^',0')=/3(X,^,0), 

and 

N{x',^P')=Nix,^)■ 

Then, obviously, 

L{x, ^, 0) = L{x, ^P) = L{x', 4^', 0') > Lix', ^') (97) 

(see ([7])) and Remark [3731 

By Theorem 16.11 there can not be a strict inequality in the last inequality 
in (1971) . so L{x,ip) = L{x',ip'). From Theorem 16.11 it follows now that (x','0') 
satisfies ((86]) - ([9nD as well. □ 
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